27 - Beyond the Patterns - Luis Pineda - Active MR k-space Sampling with Reinforcement Learning [ID:31815]
50 von 573 angezeigt

Welcome everybody to another episode of Beyond the Patterns.

So today I have the great pleasure to introduce Luis Pineda.

He is a researcher at Facebook AI Research Fair in Montreal.

He obtained his PhD from the University of Massachusetts Amherst in 2018, advised by

Professor Schlomo Silberstein. During his PhD he focused on developing heuristic search

algorithms for probabilistic planning and their applications to robotic problems.

At FAIR his focus has been on studying deep reinforcement learning and its applications.

His recent work includes exploring the use of deep learning for active MRI acquisition

and developing novel reinforcement learning based methods for multi-agent collaboration

in Hanabi.

So today we have the great pleasure to have Luis here as a speaker and his presentation

will be entitled Active MR Case-based Sampling with Reinforcement Learning.

Luis, great pleasure to have you here, at least virtually, and I'm very much looking

forward to your presentation.

So the stage is yours.

First of all, thanks a lot for the invitation.

I'm really happy to present their work here today.

Well, the virtual here, right?

And yeah, let me get started.

So this was work done, we collaborated with FAIR and also from McGill University.

Suman Abbasu is a student at McGill and Adriana Romero, Roberto Calandra and Michal Drossel

are from FAIR.

Yes, so let's get started.

So magnetic resonance imaging is a powerful imaging technique.

Some of its advantages over other modalities like computational tomography include or might

include superior image quality and zero radiation exposure.

But unfortunately, MRI acquisition is very slow.

Sometimes it can take an hour or more.

And then this can lead to patient discomfort and artifacts due to patient motion.

From personal experience, the MRI, being an MRI machine is a pretty stressful process.

You have to be sitting still or lying still for quite a while.

So anything to reduce this time will be of great benefit.

So I think I'm guessing a lot of people here know this much better than I am, but just

as a sort of like for context, MRI works is that it scans what's so called raw case-based

measurements, which are a 2D frequency representation of an image.

And from this collected case-based data, an image can be reconstructed using an inverse

Fourier transform.

So as the video shows, every time we acquire some frequencies, so in this 2D plane, they

say we are acquiring rows of frequency measurements, then each additional row gets acquired, the

images keeps getting sharper and sharper.

And typically it's not that the frequencies are acquired in just kind of completely free

order where there is some sub-sampling pattern, for example, rows as in the video or columns

or some other type of pattern of acquisition.

So this means that an obvious way to accelerate this process would be to use a sub-sampling

pattern that instead of acquiring all the possible frequencies for reconstructed image,

you only acquire a partial number of them and then apply some reconstruction technique

to do that.

So here is an example of possible acquisition patterns or also called random masks, different

acceleration factors.

So you can have some random pattern or some equi-space pattern of acquisition and different

Teil einer Videoserie :

Zugänglich über

Offener Zugang

Dauer

00:47:29 Min

Aufnahmedatum

2021-04-27

Hochgeladen am

2021-04-28 00:46:38

Sprache

en-US

Our invited speaker in this video is Luis Pineda from Facebook AI Research!

Abstract: Deep learning approaches have recently shown great promise in accelerating magnetic resonance image (MRI) acquisition. The majority of existing work have focused on designing better reconstruction models given a pre-determined acquisition trajectory, ignoring the question of trajectory optimization. In this paper, we focus on learning acquisition trajectories given a fixed image reconstruction model. We formulate the problem as a sequential decision process and propose the use of reinforcement learning to solve it. Experiments on a large scale public MRI dataset of knees show that our proposed models significantly outperform the state-of-the-art in active MRI acquisition, over a large range of acceleration factors.

Bio: Luis Pineda is a researcher at Facebook AI Research in Montreal. He obtained his PhD from University of Massachusetts Amherst in 2018, advised by Prof. Shlomo Zilberstein; during his PhD, he focused on developing heuristic search algorithms for probabilistic planning and their applications to robotics problems. At FAIR, his focus has been on studying deep reinforcement learning and its applications. His recent work includes exploring the use of deep RL for active MRI acquisition, and developing novel RL-based methods for multi-agent collaboration in Hanabi. 

Reference:
Pineda, Luis, Sumana Basu, Adriana Romero, Roberto Calandra, and Michal Drozdzal. "Active MR k-space sampling with reinforcement learning." In International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 23-33. Springer, Cham, 2020.
https://link.springer.com/chapter/10.1007/978-3-030-59713-9_3

This video is released under CC BY 4.0. Please feel free to share and reuse.

For reminders to watch the new video follow on Twitter or LinkedIn. Also, join our network for information about talks, videos, and job offers in our Facebook and LinkedIn Groups.

Music Reference: 
Damiano Baldoni - Thinking of You (Intro)
Damiano Baldoni - Poenia (Outro)

Tags

beyond the patterns
Einbetten
Wordpress FAU Plugin
iFrame
Teilen